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Fleming  and  his  associates  conducted  research  on  the  following 
topics : 

a)  Nonlinear  filtering.  Analytical  and  numerical  techniques  for 
approximately  optimal  nonlinear  filters  were  studied  by  Fleming's  Ph.D. 
student  R.  McGwier.  The  analytical  results  take  the  form  of  a  regular 
perturbation  expansion,  while  the  numerical  results  are  based  on  moving 
finite  elements.  A  preliminary  report  was  given  in  Reference  [1)  with 
details  in  [2] . 

b)  Large  deviations  problems.  In  [3]  Fleming  and  Tsai  obtained 
asymptotic  estimates  for  minimum  exit  probabilities,  associated  with 
nearly  deterministic  controlled  diffusion  processes.  The  method  used 
probabilistic  and  differential  games  ideas.  Recently  Fleming  and 
Souganidis  found  a  much  simpler  approach  to  those  results,  based  on 
the  viscosity  solution  technique  in  partial  differential  equations. 

These  results  were  reported  in  {4J ,  with  a  detailed  paper  in  presentation. 

Reference  [5]  explains  a  stochastic  control  approach  to  large 
deviations  problems.  Two  kinds  of  large  deviations  problems  are  con¬ 
sidered.  One  is  for  nearly  deterministic  Markov  processes  (including 
results  of  Ventsel-Freidlin  type) .  The  other  is  for  Donsker-Varadhan 
type  problems,  including  stochastic  formulas  for  the  dominant  eigenvalue 
associated  with  a  Markov  process. 

In  reference  [6]  Sheu  obtained  large  deviations  results  about  the 
invariant  density  for  nearly  deterministic  diffusions.  These  may  be 
regarded  as  a  first  step  toward  the  difficult  problem  of  justifying  a 

WKB-type  expansion  for  invariant  densities,  including  optimal  results 
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wide  class  of  control  models  are  described  in  terms  of  dynamics  which 
are  deterministic  between  random  times  when  jumps  in  the  state  of  the 
system  being  controlled  occur.  Examples  are  resource  exploration- 
consumption,  storage,  and  virtual  waiting  time  problems.  In  many 
instances  there  are  in  addition  state  space  constraints.  Fleming's 
Ph.D.  student  H.  M.  Soner  has  undertaken  a  study  of  such  problems,  in 
a  series  of  papers  [7] ,  [8] ,  [9] . 

d)  Stochastic  varaitional  calculus.  A  stochastic  variational 
calculus  is  described  in  tlO] .  When  applied  to  a  special  class  of 
fixed  endpoint  stochastic  variational  problems,  it  gives  a  new  function 
space  integral  representation  for  fundamental  solutions  to  linear 
second  order  parabolic  partial  differential  equations. 

Kushner  worked  on  the  following  topics: 


a)  Approximating  multiple  I  to  integrals  with  band-limited  processes. 

Such  problems  arise  in  many  applications:  in  using  or  approximating 
liklihood  ratios  under  realistic  noise  conditions,  in  approximating  non¬ 
linear  filters  by  a  sum  of  multiple  integrals  with  respect  to  the  obser¬ 
vation  ,  etc . 

Let  ne(*)  denote  a  "wide-band  width"  vector  valued  process.  We 
are  concerned  with  limits  of  I  I  n  (t)L(T,s)n  (s)dxds,  and  for  the 
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m-multiple  integral  case.  For  the  most  important  case,  a  weak  conver¬ 


gence  result  is  obtained,  and  the  "correction"  terms  exhibited.  The 


method  is  such  that  the  conditions  used  can  readily  be  weakened.  An 
application  to  a  likelihood  functional  and  hypothesis  testing  problem 
is  given.  There,  the  weak  convergence  result  (rather  than  mere  con¬ 
vergence  of  finite  dimensional  distributions)  is  essential  if  the 
limit  approximation  is  to  make  sense  as  an  approximation  to  the  likeli¬ 
hood  functional.  The  correction  terms  depend  only  on  the  limit  (as 
e  -*■  0)  of  the  correlation  function  of  the  (renormalized)  ne(*).  The 
conditions  are  reasonable  with  respect  to  the  applications.  See  [11] . 

b)  Large  deviations  methods  and  asymptotic  properties  of  recursive 
algorithms .  Recursive  algorithms  appear  in  numerous  contents  in  control 
and  communication.  Typically,  one  is  interested  in  quantities  relating 
to  error  or  to  the  escape  time  or  probability  of  the  estimate  from  some 
stable  point  of  the  algorithm  (as  in  tracking  problems  where  the  error 
is  the  tracking  error  and  the  stable  point  is  the  origin) .  The  large 
deviations  methods  provide  a  powerful  tool  for  this. 

Asymptotic  properties  of  Robbins-Munro  and  Kiefer-Wolfowitz  type 
stochastic  approximation  algorithms  are  obtained  via  the  theory  of  large 
deviations.  The  conditions  are  weak  and  can  even  yield  w.p.l.  convergence 
results.  The  probability  of  escape  of  the  iterates  from  a  neighborhood 
of  a  stable  point  of  the  algorithm  is  estimated  and  shown  to  be  considerably 
smaller  than  suggested  by  the  classical  'asymptotic  normality  of  local 
normalized  errors'  method  of  getting  the  asymptotic  properties.  The 
escape  probaiblities  are  a  natural  quantity  of  interest.  In  many  appli¬ 


cations,  they  are  more  useful  than  the  'local  normalized  mean  square 
errors'.  Other  large  deviations  estimates  are  also  obtained.  Typically 


-4- 


if  a^  =  l/nP,  p  <_  1,  then  the  probability  of  escape  from  a  neighborhood 

m 

of  a  stable  point  in  sane  (normalized)  time  interval  [n,m] :  £  a.  -  T 

p  n 

is  exp  -  n  V  ,  where  does  not  depend  on  p  for  p  <  1  and  is 

the  solution  to  an  optimal  control  problem.  If  the  noise  is  Gaussian, 
then  the  optimal  control  problem  is  relatively  easy.  Under  quite  broad 
conditions,  in the  Kiefer-Wolfowitz  case  the  control  problem  has  the 
Gaussian  form,  whether  or  not  the  noise  is  Gaussian.  The  techniques 
are  expected  to  be  quite  useful  in  the  analysis  of  the  asymptotic 
properties  of  recursive  algorithms  generally.  See  [12]. 


c)  Approximation  and  modelling  for  distributed  stochastic  systems. 
Noise  driven  evolution  equations  are  a  natural  and  commonly  used 
model  for  'distributed*  stochastic  systems.  Typically  one  assumes 
•white'  noise,  although  in  applications  this  is  not  reasonable.  In 
two  papers  [13,14],  summarized  below,  we  show  how  to  approximate  the 


'real'  system  by  the  'ideal'  system,  in  the  sense  of  finding  the  best 


approximation,  when  the  noise  bandwidth  is  large. 

Let  B^  (a  first  order  differential  operator) ,  and  B^  be 
functions  of  x  and  of  a  'wide-band  width*  random  process  ('band-width* 
as  c  0) .  Define  uc  by  (A  is  an  elliptic  operator) 


TT  -  Aue  ♦  i[BP  ♦  B^]ue  ♦  i  Bp,  Ue(0)  -u0. 


£ 

Under  appropriate  conditions,  {u  (•)}  converges  weakly  to  a  process 
u(*)  which  solves  a  stochastic  PDE,  driven  by  a  cylindrical  Wiener 
process.  The  treatment  is  entirely  probabilistic.  Methods  which  the 
authors  applied  previously  to  the  finite  dimensional  cases  are  modified 
and  extended  for  the  current  class  of  problems. 


For  an  alternative  approach  consider:  For  a  parabolic  equation 
with  wide  bandwidth  coefficients,  we  show  that  the  solution  converges 
weakly  to  that  of  a  stochastic  PDE  driven  by  an  infinite  dimensional 
Wiener  process  as  the  bandwidth  tends  to  infinity.  The  treatment  is 
novel  and  purely  probabilistic.  The  solution  to  the  "wide  band"  coef¬ 
ficient  system  is  represented  as  a  conditional  expectation  of  a  functional 
of  a  certain  diffusion.  By  a  weak  convergence  argument,  the  conditional 
expectation  (and  its  mean  square  derivatives)  converges  weakly  to  a 
conditional  expectation  of  a  functional  of  a  "limit"  diffusion.  It  is 
then  shown  that  this  "limit"  functional  satisfies  the  appropriate 
stochastic  PDE.  The  infinite  dimensional  Wiener  process  is  represented 
explicitly  in  terms  of  the  original  system  noise.  No  coercivity  or 
strict  ellipticity  conditions  are  required.  The  result  provides  a 
partial  justification  for  the  use  of  infinite  dimensional  wiener 
processes  in  distributed  systems.  Since  the  method  is  based  on 
weak  convergence  arguments  for  Ito-type  equations  with  wide  bandwidth 
coefficients  and  "PDE  methods"  are  avoided,  it  is  likely  that  the 
technique  will  find  greater  use  in  the  analysis  of  infinite  dimensional 
stochastic  systems. 
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